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1  Introduction 


Throughout  this  article,  {X^Xn\  >  1}  will  denote  a  sequence  of  independent 
identically  distributed  real  random  variables  (i.i.d.  random  variables)  with  com¬ 
mon  distribution  function  F  given  by  F(x)  =  P{X  <  x),  x  €  7^,  the  real  line. 
For  each  positive  integer  7i,  let  Xijn  <  X2:n  ^  £  Xnm  the  order  statistics 

of  Xx,  A'2,  ATn*  Let  //  be  a  real  valued  measurable  function  defined  on 
IZ.  Liiujiir  combinations  of  order  statistics  (in  short,  L-statistics)  are  statistics 
of  the  form 

^n= 

n 

where  the  weights  1  <  i  <  n,  n  >  1,  are  real  numbers. 

Research  in  L-statistics  has  been  active  for  more  than  20  years.  Much 
is  known  about  their  limit  behaviours  including  asymptotic  normality,  Berry- 
Esseen  type  bounds  for  normal  approximation,  Cramer  type  large  deviations, 
the  law  of  tlie  iterated  logarithm  and  the  Kolmogorov  type  strong  laws  of  large 
numbers  under  quite  general  conditions.  See  Helmers  (1977),  Mason  (1982), 
Mason  and  Shorack  (1992),  Sen  (1978),  Shorack  (1972),  Stigler  (1974),  Van 
Zwet  (1980),  VVellner  (1977a,  b),  etc  and,  in  particular,  two  books  by  Serfling 
(1980)  and  Shoriick  and  Wellner  (1986)  and  references  therein.  To  our  knowl¬ 
edge,  however,  all  results  established  for  L-statistics  need  //(•)  to  be  a  known 
function  of  the  form  /7(-)  =  /7i(')  —  7/2(*)  with  each  Hi  t  and  left  continuous. 
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Furthermore,  //i(-)  and  //2(’)  should  also  satisfy 


0<t<l  (1.1) 

with  some  fixed  Mi,  di  and  where 

F'^{t)  =  inf  {s;  F(3)  >  t}  ,  0  <  ^  <  1. 

Some  conditions  on  {cj^n;  n>l}  are  also  needed.  One  often  chooses 

Ci  n  =  ./(“),  1  <  i  <  71,  n  >  1 

n 

where  ./(t)  satisfies  some  continuous  condition  in  (0, 1)  Jis  well  as 

|./(i))|  <  M2r‘"(i o<t<i  (1.2) 

with  some  fixed  A/^,  hi  and  For  obtaining  either  central  limit  theorem  or 
the  law  of  the  iterated  logarithm  for 

n>l, 

furtlicr  coiiditioii  oii  bi,  62,  di  and  is 

a  =  max{6i  +  ^1,62  +  ^2}  < 

These  conditions  sometimes  are  not  easy  to  be  vertified. 

Example  1.1  Let  p  >  1  and  (X,  Xn\  n  >  1}  a  sequence  of  i.i.d.  random 
varial:)l<>i  with  common  density  function 

I  fracC,\xfiL\x\r,  |.r|  >  . 

/(a-)  =  < 

0,  \x\  <  c 
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where  Cp  >  0  is  a  constant  such  that  /(x)dx  =  1.  Here  and  the  following 
Lx  =  logg  max{e,x}  and  Lqx  =  L(Lx),  x  £71.  Clearly, 

op 

jE;(X)=0  and 

P-  1 

It  is  easy  to  check  that 

2“*CpX"*(L|x|)"P  as  X — cx), 

F(x)  =  P{X  <  x)  ~  ^ 

1  -  2“*CpX“*(L|x|)“P  asx— >oo. 

Hence 

Choose  H{x)  =  X  and  J(i)  =  1.  It  follows  that  one  can  not  find  6i,  62,  di  and 
da  such  that  (1.1)  and  (1.2)  hold  and 

a  =  max{6i  H-  di,  62  -h  ^2}  < 


Thus,  ])y  using  any  result  of  the  law  of  the  iterated  logarithm  for  L-statistics 
established  so  far,  one  can  not  say  anything  about 


limsup 


rUJ{i)Xi^n 

\/2n  log  log  71 


=  limsup 


Er=l 

/2nlog  logn 


which  the  cUissical  Hartman-Wintner  law  of  the  iterated  logarithm  asserts  that 
the  limit  superior  equals  to  (2C'p/(p—  l))^'^^  almost  surely.  As  Wellner  (1977b) 
mentioned,  the  chissical  law  of  the  iterated  logarithm  docs  follow  only  if  tlie 
second  moment  condition  is  strengthened  to  r-th  moment  condition  for  some 
r  >  2.  See  Example  la  on  page  492  in  Wellner  (1977b). 


Example  1.2  Let  W  be  a  standard  Wiener  process  on  7Z  (i.e.  {W(t);  t  > 


0}  and  {W(— t);  i  >  0}  are  two  independent  copies  of  Wiener  process  starting 
from  0),  and  let  {X, X„;  n  >  1}  be  a  sequence  of  i.i.d.  random  variables, 
independent  of  W.  For  any  given  path  of  W,  we  consider  L-statistics 


^-W(X<:n),  n>l. 

f  71 


t=l 

As  wc  know,  for  almost  every  path  of  W,  W  can  not  be  represented  as  the  form 
W  =  Wj  —  W2  with  Wi  I  and  left  continuous.  One  also  can  not  say  anything 
about 


Urn  sup 


v/2n  log  log  n 

for  some  sequence  {An\  7i  >  1},  by  using  any  result  of  the  law  of  the  iterated 
logarithm  for  L-statistics  established  so  far. 

Motivated  by  these  examples  above,  one  of  the  main  objectives  of  this  paper 
is  to  find  necessary  and  sufficient  conditions  for  the  law  of  the  iterated  logarithm 
and  the  central  limit  theorem,  respectively,  of  L-statistics  under  some  very  re¬ 
laxed  conditions  on  //(■)•  In  fnct,  from  Theorems  2.1  and  2.2  in  this  paper,  wc 
can  find  that  the  only  condition  on  //(■)  we  need  is  E{\H{X)\)  <  00.  We  should 
note  that  ./(■)  is  strengthened  to  be  a  Lipschitz  function  of  order  1  when  //(•) 
is  relaxed. 

It  is  valuable  to  give  an  outline  of  the  main  idea  of  proofs  of  Theorems  2. 1 
and  2.2.  Throughout  this  paper,  [U,Un\  Ti  >  1}  represents  a  sequence  of  iid 
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random  variables  with  uniform  (0, 1)  distribution.  Then,  we  have 


{X,  X„;  n  >  1}  i  n  >  1} 

where  means  equal  in  distribution.  This  is  a  well-known  fact.  It  now  follows 
that 

1  <  i  n>l}  =  1  <  ^  ^  >  1} 

where  (Jun,  1  <  ^  ^ire  the  order  statistics  of  C/»,  1  <  i  <  n.  Note  that 

P{U,^Uj  for  all  l<<j<oo)=l. 

So  we  have  that 


=  E7=lAUi:n)H{F-iUi..n)) 

+  E?-,  (Ai)  -  J{Ui..n))H{F-iUi..n)) 

="•  T^^iJmHiF-iUi)) 

+  Er=l  {A^niUi..n))  -  J{Ui:n))  H  {F^  {Ui-n)) 
i  S„  +  R^,  n>l 

where  is  the  empirical  distribution  function  of  f/i,  Un-  Clearly, 

classical  results  can  be  applied  to  the  first  part  5n  above.  As  for  the  second 
part  Rn,  we  may  try  to  apply  some  known  results  for  the  empirical  processes  to 
Rri  to  obtain  what  we  want.  However,  we  can  not  misunderstand  that,  under 
some  conditioirs  (except  J{t)  =  C  some  constant),  both  the  law  of  the  iterated 
logarithm  and  the  central  limit  theorem  for  ^  only 
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depend  on  >  1.  We  shall  know  this  from  Theorems 

2.1  and  2.2. 

This  apj^roach  is  quite  simple.  The  empirical  process  is  a  powerful  tool 
which  luis  now  become  a  standard  technique  in  proving  limit  theorems.  See,  for 
example,  Cilat  and  Hill  (1992)  Mason  and  Shorack  (1992),  Shorack  and  Well  nor 
(1986)  and  references  therein.  In  Section  3,  we  show  further  that  this  approach 
can  be  api)licxi  to  obtain  necessary  and  sufficient  conditions  for  cither  almost 
sure  ronv(M  gence  or  convergence  in  distribution  of  some  well-known  L-statistics 
or  U-statisti(\s.  This  is  the  second  main  objective  of  this  paper. 

It  is  very  natural  to  coiisider  the  case  of  general  scores  1  ^  i  ^  ^  I 

with 

sup  |c,>l<oo. 

l<t<n,7l>  1 

In  this  connection,  one  may  iisk  what  we  can  say  about  the  law  of  the  iterated 
logarithm  for 

n 

JI>1. 

i=i 

We  shall  have  some  certain  sense  iibout  this  problem  by  a  result  on  what  we 
call  a  law  of  the  logarithm  for  L-statistics.  See  Section  4. 

2  Main  Results 

In  this  s(K*tiom  we  give  our  main  results  of  this  paper  as  well  t\s  their  proofs. 
Let  A'  \hi  a  rc<il  random  variable  with  distribution  function  F{x)  and  U 
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a  random  variable  with  uniform  (0, 1)  distribution.  Let  H{-)  be  a  real  Borel- 
measurable  function  defined  on  TZ  with 


£:(|//(X)|)  <  oo.  (2.1) 

Then  we  write 

fi  =  fi{F,  J,H)  =  E  {J{U)H{F-  (U)) 

exists  for  all  ,/(•)  £  (7(0, 1],  the  set  of  continuous  functions  defined  on  [0, 1].  For 
every  given  Lij)schitz  function  »/(♦)  of  order  1  defined  on  [0,  l],  write 

f  Z=^J{U)H{F-{U)), 

<  (2.2) 

Then  V  and  Z  are  two  random  variables  under  (2.1).  It  is  easy  to  see  that 

E{\Y\)  <  oo  and  E{Y)  =  0  (2.3) 

and  that 

cr^  =  Var(K)  =  E{Y'^)  <  oo  (2.4) 

if  and  only  if 

E{Z‘^)  <  oo.  (2.5) 

Let  7/  >  1}  be  a  sequence  of  random  variables.  We  say  that  n  >  1}  is 
bounded  in  jirohability  if 

lim  sup  P(|^„|  >  x)  =  0. 

The  main  r(5>ults  in  this  j^aper  are  following  Theorems  2.1  and  2.2. 
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Theorem  2,1  (Necessary  and  Sufficient  Conditions  for  the  LIL  of  L-Statis tics)  Let 


{XyXn\  71  >  1}  be  a  sequence  of  i.i.d.  random  variables  and  //(•)  a  real  Borel- 
measurable  function  defined  on  'fZ  such  that  (2.1)  holds.  Let  J(-)  be  a  Lipschitz 
function  of  order  1  defined  on  [0,  l].  Then 

y/2n  log  log  n 

if  and  only  if  (2.5)  holds.  In  either  case, 


limsup 


IE 


<  oo 


(2.6) 


liinsii])(li!n  iiu) - .  r= -  =(— )  a 

71 -.no  V27lloglog7l 


a.s. 


(2.7) 


where  is  defiiuxl  by  (2.4). 

Theorem  2.2  (Necessary  and  Sufficient  Conditions  for  the  CLT  of  L- 
Statistics) 

Under  the  conditions  of  Theorem  2.1,  we  have  that 

1  ^  is  bounded  in  probability  (2.8) 
if  and  only  if  (2.5)  hohls.  In  either  aise, 


y/n 


N{0,a^) 


(2.9) 


where 


means  convergence  in  distribution. 


Two  remarks  arc  in  order. 

(i)  'rh(X)r(uns  2.1  and  2.2,  rcspccttivcly,  include  the  ckissical  IdL  and  the 
cliissical  Cd/I\  resi)ectively,  <us  special  cities.  (Take  J{t)  =  \,t  €  [0,  l]  and 

//(x)  =  .X,  X  G  'JZ.) 
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(ii)  From  the  proofs  of  Theorems  2.1  and  2.2,  one  can  replace  1  < 

z  <  n,  71  >  1  by  1<^<7Z,  n>l  with  U^n  €  [0, 1],  1  <  t  <  72  and 

maxi<i<„  |«i,„  -  as  n  -»  oo. 

Proof  of  Theorem  2.1  Note  that  (1..1),  (1.2)  and  (1.3)  hold  and  that 
the  classical  LIL  asserts  that 

T 

n’-*oo  v  2tI  log  log  72 

. ,in..(./WWf-(a.))-,.)|  p,io) 

71— *00  \/2n  log  log  n 

<  oo  a.s. 


if  and  only  if  (2.4)  holds.  So  the  first  part  of  the  theorem  follows  provided  we 
show  that,  under  the  conditions  of  the  theorem, 


limsup 


i«..i 


oo  \/271  log  log  n 


<2-^B{J)E{\H{X)\)  a.s. 


(2.11) 


where 

Clearly, 


\/27i  log  log  n 


B{J)  =  sup 

0<s<t<l 


J{3)  -  J{t) 


s  —  t 


<  oo. 


<  max  \J(V  (U-  11  -  J(U  II  • 

<  m^^JJ(Pn(C/,„))  J(C/..n)(  ^2nloglogn 


=,  \H{F-iUi))\ 

y/2n  log  log  7Z 


<  S( J)  \V„{Ui..n)  -  ^ 


lloglogTl/  o<t 
By  Smirnov’s  (1944)  law  of  the  iterated  logarithm, 

1/2 


(t^.))l- 
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and  by  Kolmogorov’s  strong  law  of  large  numbers, 

=  E{\H{F-{U))\)  =  £;(|//wi)  a.s. 

i=l 

Consecjucntly,  (2.11)  and  hence  the  first  part  of  the  theorem  follows. 

We  now  ])rove  that  conditions  (2.1)  and  (2.5)  imply  that  (2.7)  holds.  Con¬ 
sider  the  following  two  Banach  spaces 

B.  =  |m-):  IIM-)IIi  =  HF-{t))\dt  <  oo 

and 

B2  =  |/i(-);  ||/^(•)||2  =  (j(‘  JHt)h:\F-{t))dt 

Let  Ai  denote  the  class  of  all  real  valued  functions  /i(-)  defined  on  7v  satisfying 

h\x)  is  continuous  on  'fZ 

and 

h'(^x)  =  0  when  |x|  is  large  enough. 

It  is  e<isy  to  siiow  that  is  a  dense  subset  of  both  Bi  and  B2.  It  follows  that, 
for  any  given  s  >  0,  since  (2.1)  and  (2.5)  hold,  there  exists  //^(O  ^  Ai  such  that 

E{\II{X)  -  He{X)\)  <  e  Var(r  -  K)  <  e 

and 

Var(Z-Z,)<£ 

where 

Z.  =  J{U)IF(F-{U))  fle=EiZe) 
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Write 


Jo 


He{‘)  -  H{-)  -  He{*)  and 
Noting  (1.3),  (2.10)  and  (2.11),  we  have  that 


limsup 


y/2n  log  log  n 


Let 


Then 


<  yVar(Z  -  Z,)  +  2-^B{J)E{\He{X)\) 
—  ^F{J)e  a.s. 

/-C(x)  =  r 

J -oo 

(x)  —  ^  f  ^^£(^)^{//^(i)<o}^* 

J -oo 

H,{x)  =  Ht{x)^H:{x). 


(2.12) 


One  now  can  ciisily  check  that  ./(•)  and  He{’)  satisfy  all  conditions  for  Theorem 
4  of  Wellner  (19771))  (See  also  Theorem  19.2  on  page  665  of  Shorack  and  Wellner 
(1986)).  We  thus  have 


.  n.  ^  rXUAi)He{Xi:n)-n^e  ,  +  , 
hmsup(hminf) — — —  == - =(*-) 

n-*oo  n  — oo  ^271  log  log  71 


a.s. 


(2.13) 


where 


a'i  =  Var  (^j\l^i;<t}-t)J{t)dH,:{F-{t))^  . 
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Since  J(*)  is  a  Lipschitz  function  of  order  1  defined  on  [0, 1],  we  have  that 


Jo  ^ 

Jo 

=  v;. 

Thus 

af.  — ►  =  Var(K)  £is  e  i  0. 

Letting  £  [  0  and  combining  (2.12)  with  (2.13),  (2.7)  follows,  and  the  ])roof  of 
the  th(x>rcm  Ls  complete.  □ 


and  by  Theorem  19.1  on  page  664  of  Shorack  and  Wellner  (1985), 


i/n 

Combining  (2.14)  with  (2.15),  (2.9)  follows.  □ 


iV(0,a2). 


(2.15) 


3  Applications  and  Examples 

In  this  section,  weshow  further  how  either  our  approach  addressed  in  Section 
1  or  Theorems  2.1  and  2.2  can  be  applied  to  obtain  necessary  and  sufficient 
conditions  for  either  almost  sure  convergence  or  convergence  in  distribution  of 
some  L-statistics  or  even  U-statistics. 

As  an  application  of  our  approach,  we  state  the  following  interesting  result. 
Its  proof  is  left  to  the  readers. 

Theorem  3.1  Let  {X,  Xn;  >  1}  be  a  sequence  of  i.i.d.  random  variables 
and  //(•)  a  real  Borel- measurable  function  defined  on  71.  Let  J(*)  be  a  Lipschitz 
function  of  order  1  defined  on  [0, 1].  Then,  we  have 

(i)  If  there  exists  a  rciil  sequence  {6„;  7i  >  1}  such  that 


as  n 


oo 


(3.1) 


and 


71  —  00  n\/bn 


(.3.2) 
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then,  for  any  real  sequence  {A„;  n  >  1}, 


lim  infn-.oo)  ^ 

=  lim  sup, (lim  infn--.oo)" 


y/2n(\og  logn)6n 

EL,  J{Ui)H{F-{Ui))-Ar. 

y/2n{\og  logn)6„ 


(ii)  If  there  exist  sequence  {bn]  n  >  1}  and  {An;  >  1}  such  that  (3.2) 


holds  and 


where  f /(:/-)  is  a  distribution  function,  then 


Er=fA^)//(^i.n)-A„  cl 


As  a  corolaary  of  Theorem  3.1,  we  have 

Corollary  3,2  Let  //(•)  and  J(*)  be  the  same  as  in  Theorem  3.1.  Let 


Z  =  J{U)H{F-{U)). 


E{\H(X)\)  <oo,  E{Z^)=oo 


and  Z  is  in  the  domain  of  attraction  of  the  normal  distribution,  then,  there  exist 
sequencf;  {An;  >  1 }  and  [Dn  >  0;  n  >  1}  such  that 


N{0,1) 


where  may  be  rhoseui  iis 


Bn  =  sup  |c  ;  c~‘^E{Z'^I{^z\<c}}  >  - 
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and  An  niay  be  taken  as 


=  ^EiZI{\Z\  <  B„}). 

Proof  Since  Z  is  the  domain  of  attraction  of  the  normal  distribution,  we 
have  that 

for  some  >  1 }  and  (Z?n;  >  1}  and  they  may  be  chosen  as  above,  where 

{Zn;  1}  i-*^  a  sequence  of  i.i.d.  random  variables  with  common  distribution 
function  cis  Z's.  Note  that  E{Z'^)  =  oo.  So 

Bn  =  \/n(Byn)  =  \/nbn,  7i  >  I 

with  bn  =  b‘fjn  — ►  oo  <is  ii  — ►  oo.  Now,  it  follows  that  E{\H{X)\)  <  oo 
implies  that  (3.2)  holds.  By  Theorem  3.1,  (3.6)  follows.  □ 

Remark  It  is  interesting  to  note  that,  when  E{\H{X)\)  <  oo,  E{Z‘^)  =  oo 
and  Z  is  in  the  domain  of  attraction  of  the  normal  distribution,  An  and  are 
deterinincxl  by  Z,  not  Y. 


'  Let  {A',  A'n;  ii  >  1}  be  a  sequence  of  i.i.d.  random  variables.  Gini’s  mean 
difference, 


considered  iis  a  U-statistic  for  unliiiised  estimation  of  the  dispersion  parameter 


0  =  E{\X,  -  X-2\), 
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is  introduced  in  both  Serfling  (1980,  page  263)  and  Shorack  and  Wellner  (1986, 
page  676).  It  may  be  represented  as  an  Lrstatistic  as  follows 


n[n  —  1) 


l<»<j<n  i=l 


(3.7) 


Using  'riicorenis  2.1  and  2.2  and  our  approach,  we  can  establish  the  following 
result. 

Theorem  3.3  (I)  (Kolmogorov’s  SLLN  for  G ini’s  mean  difference) 


^  V  ^ 

limsup— - —  >  |X<  — X.|<cx3  a.s. 

n-.oo  Hn-y) 

if  and  only  if 


E{\X\)  <  oo. 


(3.8) 


(3.9) 


In  either  cjuse. 


2 


E  \Xi-Xj\  =  0=E{\Xy-X2\)  a.s.  (3.10) 


(ii)  (IdL  for  Gini's  me^in  difference)  For  some  0, 

2 


limsup 
71— too  y  2  log  log 

if  and  onlv  if 


7l{7l  —  1) 


E  \Xi-X^\-0 


1<  t<  j<n 


E{X'^)  <  oo. 


<  oo  a.s.  (3.11) 


(3.12) 


In  citlicr  case,  0  =  E(\X\  —  X^l)  and 


liiii.sui)(liminf) J— — ^ -  I  -r - -  V  |A:i-A',|-/y 

,.-.00  "  V  21oglog7t  yn{n-  1) 


=(-)rr  a 


(3.13) 


18 


where 


=  Var(r) 


(3.14) 


and 


=  [  If  |y  -  x\dF{x)  dF{y)  -  6^ 

J  —  oo  lJ  —  oo 

Y  =  -{2U  -1)F^{U)+9^2  f\l{u<t}  -  t)F-  {t)dt. 

Jo 

(iil)  (CLT  for  Gini’s  mean  difference)  For  some  0, 


j  ^  ^  ^  \Xi  —  Xj  \  —  0  ;  71  >  1  >  is  bounded  in  probability 


77(71  —  1) 


(3.15) 


if  and  «)iily  if  (3.12)  holds.  In  either  case,  0  =  E{\Xi  —  X2I) 
2  ^  .  d 


E  —  W^')  (3.16) 

^  l<i<J<n  J 

where  rr^  is  defined  as  in  (3.14). 

Remark  Shorack  and  Wellner  (1986,  page  677)  obtained  (3.16)  under  the 
assumption  that  E{\X\'^'^^)  <  oo  for  some  6  >  Q. 


Proof  of  Theorem  3.3  Take  J{t)  =4i  —  2,  0<^<1  and  H{x)  =  x,  x  G 
'IZ.  Then  (3.9)  implies  that 

I,,.,  SL.:^gL).r(^')  .  f\u-2)F-m 

n-*oo  71  Jo 

=  /  /  F^{3)\d3dt 

Jo  Jo 

=  0  a.s. 

and 

liin  ^  0  a.s.  (3.17) 

n— oo  n\/bn 
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where  bn  =  \/n/ 


rji  — ►  oo  as  n  — ►  oo.  By  Theorem  3.1,  we  have  that 


hm  - - - =  0  a.s. 

71— »00  fl 


Note  that  (3.9)  also  implies  that 


as  n  — ►  oo. 


So  (3.7),  (3.18)  and  (3.19)  together  imply  that  (3.10)  holds. 

VVe  now  ]>rovo  that  (3.8)  implies  (3.9).  Obviously,  (3.8)  implies  that 

2  ^  ^ 

- TT  -  X2i\<oo  a.s. 

71^00 

Since  {|A'27i-i  —  A'2n|;  //  >  1}  is  a  sequence  of  i.i.d.  random  variables,  it  follows 
that  /r(|A'i  —  A'^l*^*^)  <  oo  which  is  equivalent  to 


<oo. 


Thus  (3.19)  holds.  Combining  (3.8)  with  (3.19),  we  have  that 


IEr=l*/(^)^i=n|  . 

hmsup - - -  <  oo  a.s. 

71— ►CO  71 


Note  that  (3.20)  is  equivalent  to 


ELjM 


71—00  77\/'n2 


=  0  a.s. 


By  TlKX)i(Mn  3.1  and  noting  (3.20), 


litii  sup 


71  -.OO  >/27/.(loglog 


=  limsup 


71  —  00  ^27i(log  log7l)7t'-^ 


=  0  cl.S. 
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which  implies  that,  for  all  e  >  0, 


e(^\J{U)F'-{U)\^-^^  =  2) F'-{t)\^-^dt  <oo.  (3.22) 

Since  |J(0)J(1)|  =  4  >  0,  it  is  easy  to  check  that  (3.22)  is  equivalent  to 

=  E(|X|^-")  <oo. 

In  })articular,  we  have  that 

E{\X\^^^\L.2\X\))  <  oo 

which  is  etjui valent  to 


Using  Tlieorem  3.1  and  noting  (3.21)  again,  we  have  that 


71 

=  0  a.s. 

which  is  equivalent  to 

E(|J(C/)F‘-(C/)|‘'‘/‘^)  <  oo 

and  hence 

£(1X1*“/*^)  <oo.  (3.23) 

Siiiro  ^  |:f,  (3.23)  implies  that 


IEL.-^a/i)F^(Ci)| 

/27).(log  logn)7l“’/7/  log  log  71 


\n=iAUi)F-{Ui)\ 

V2n^ 


Using  Theorem  3.1  and  noting  (3.21)  again,  we  have  that 

ii,„  ^  I  EL.  J{Ui)F^m\ 

\/2n{\og  \ogn)n/  log  logn  ^-*0°  \/2n 

<  00  a.s. 

which  is  equivalent  to 

£:(|J(f/)F-(t/)|)<oo 

and  hence  (3.9)  follows.  The  proof  of  (i)  therefore  complete. 

Using  ^h(^  same  tcxrhniquc  Jis  it  luis  just  been  used  above,  one  can  show  that 
either  case  of  (3. 11)  and  (3.15)  implies  that  (3.12)  holds  and  0  =  ^dJ^i  —  ^^2!). 
Now  applying  Theorems  2.1  and  2.2,  (ii)  and  (iii)  follow.  □ 

Another  important  application  of  our  approach  and  results  is  on  the  expec¬ 
tation  of  order  statistics.  Let  9^.  =  E{Xi:k)  where  Xi:k  is  the  minimum  value 
(smallest  order  statistic)  in  a  sample  of  size  k.  Then  an  estimate  of  Of^  bcisc'd  on 
a  siirn]:)l(j  of  size  n  is 

■Tn  =  (a:)  ^  inin{Xi,,-  -,XiJ 

(n.fc) 

where  the  sum  ^  taken  over  all  subsets  1  <  Zi  <  •  •  •  <  u-  <  7i  of 

{1,2, n}.  Obviously,  is  also  a  U-statistic. 

As  it  is  dcxluced  in  Lee  (1990,  page  G5),  Tn  can  also  be  represented  as  an 
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Lrstatistic  as  follows 


1 _ V'Ti 


(fc-l)! 


(n  —  i){n  —  i  —  I)-  -  ■{n  —  i  —  k  +  2)Xi:„ 


at* -  (E:‘=,{n  -  +  Cl  Er=,(n  -  +  '  ’  '  +  Ci.._2  !:?=.("  -  i)Xi.n) 


where  Ci ,  C2, ...,  Ca:-2  are  constants  depending  on  k  only.  Note  that 


/n\ 


and,  for  i  =  1,2,.. 

(n  - 


(71 VA:!)  (&-  1)! 


=  < 


i  \*=-i 


■j  =  1. 

J>2. 


So  we  take  J{t)  =  (I  0  <  ^  <  1  and  H{x)  —x,  x  e  7^.  Using  Theorems 

.3.1,  2.1  and  2.2,  we  have  the  following  results. 

Theorem  3.4  Let  {X,  Xn;  n>  1}  be  a  sequence  of  i.i.d.  random  variables. 
Then,  we  have 


(1)  If  there  exists  p  >  §  such  that 


E{\X\^)  <  oo 

then  the  following  three  statements  are  equivalent 

U(|min{X,,X2,...,X;t}|)  <oo 
k 


(3.24) 


limsup 

n-*oo 


i=l 


<  oo  a.s. 


(:{.2.'7) 

(.1.2C) 
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limsup|T„|  <  oo  a.s.  (3.27) 

n—too 

In  every  case,  we  have  that 

n  ^  ^ 

’  9k  a.s.  (3.28) 

(li)  If  SdAT])  <  oo,  then  the  following  five  statements  are  equivalent: 

E  ((1  -  C/)2*=-2(F^(f/))2)  =  f  (1  _  F(x))2*- VdF(x)  <  oo  (3.29) 

J -OO 


lim  T„  =  lim  “  Y]  f  1  -  ^i:n  = 

n-»oo  n-^oo  n  ^  \  U  J 

t=l  ^  ' 


oo 

1/2 


lim  sup 


lim  sup  (  -- — ) 

n^oo  \  2  log  log  n/ 

so-^) 


\Tn-0k\<oo  a.s. 
k-l 


V 

"  T 


(3.30) 
<  oo  a.s.  (3.31) 


sqrVln  log  log  n 

|n^^‘^(Tn  -  ^A:);  >  l|  is  bounded  in  probability,  (3.32) 


is  bounded  in  probability. 

(3.33) 


In  every  cfise,  we  have  that 


f  n  \ 

lim  sup(lini  inf)  — — ; - )  (T„  -  Ok) 

n-oo  \21oglogny 


=  liinsup(lim  inf)— 7: 

71  —  00  n-*oo  y'27noglog 
4* 

=(-)  tiOk  a.s. 


Ok 


71  \  ^  ^ 


(3.34) 


n^l^{T^-0k)-^N{0,k'^al) 


(3..35) 

(3.3G) 


where 


al  =  VatiYk) 
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=  f  {hu<t}  -t){i-  tf-^dF-{t)dt. 

Jo 

Remark  If  we  replace 


Then,  similarly  wc  have  that 


/n\  ^  V  )  •••)  ^tJe  } 

ykj  {n,k) 


1 


^  ^i:n  +  ^^t:n  4"  *  ‘  +  -Ofc-  1 


)!  \i=l  t=l  t=l  / 

where  /Ji ,  D^,  ...,  Dfc_  i  are  constants  depending  on  k  only.  Thus,  we  can  state 
an  analogue  of  Theorem  3.4  for  U-statistic 


^  n>fc 

[k)  (n,fc) 


and  L-statistic 


,  n  r  .  N  A;-  1 

-E(-) 

71  \7lJ 
1=1  ' 


1 


if  we  want.  Thus,  we  can  not  only  give  an  alternative  proof  of  Theorem  1.1  of 
Gilat  and  Hill  (1092),  hut  also  improve  their  result.  For  example,  under  the 
iissumption  (3.24),  we  have  that 

A;-l 


limsup  — 

Tl— *oo  71 


s(a 


<  CO  a.s. 


(3.37) 
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if  and  only  if 


f;(|max{Xi,  A:fc}|)<oo. 


(3.38) 


In  either  case,  we  have  that 


\im  =  E{max{Xu  Xk})  a.s.  (3.39) 

n-+oo  71^ 


i=l 


Example  Let  {X,  X„;  n  >  1}  be  a  sequence  of  i.i.d.  random  variables  with 
common  density  function 

5 

It  is  ejisy  to  check  that 

£;(|x|)  =  (X). 

Thus,  Theorem  l.l  of  Gilat  and  Hill  (1992)  can  not  be  applied  to 


lim 

n-+oo  71^ 


t»l 


However,  note  tliat  f  >  f , 


E{\X\^^*)  <  CO 


and 


E  (|max{Xi,  X;t|)  <  oo,  for  all  k>2. 


So  (3.37),  (3.38)  and  (3.39)  imply  that,  for  every  A:  >  2, 
k 


=  E{m^{Xu  ....  Xk)) 
“  ^  5A;x 


i-\ 


=  / 


G(-.x)(5*.76)  +  l 
5fc 

a.s. 


dx 


5fc-  6 
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4  The  Law  of  the  Logarithm  for  L-Statistics 

Let  Xn',  n>  1}  be  a  sequence  of  i.i.d.  random  variables  with 

£;(X)  =  0  and  E{X^)  =  I  (4.1) 
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It  follows  that 


lEtlCi.nXil 

hmsup —  "  "  =-  —  oo  a.s. 

n— oo  v2nloglogn 

In  this  section,  we  give  a  version  of  (4.3)  for  L-statistics  with  no  proof.  See  Li, 
Rao  and  Tomkins  (1993)  for  the  details  of  its  prrof.  Before  we  state  our  result, 
we  introduce  some  more  notation.  Let  I={(z,n);  1  <  i  <  n,  n  >  1}.  For  a 
given  probability  measure  z/  on  the  Borel  cr-algebra  of  71,  let  5  =  S{i/  denote 
the  support  of  u.  We  will  consider  only  those  probability  measures  for  which 
S  is  bounded.  Let  P'  =  be  the  product  probability  measure  on  the  Borel 
CT-algebra  of  . 

THeorem  3>1  (A  Law  of  the  Logarithm  for  L-Statistics)  Let  {X,  Xn\  fi  > 
1}  be  a  sequence  of  i.i.d.  random  variables  and  H{-)  a  real  valued  measureable 
function  defined  on  7Z  such  that 

E{H'\X))  <oo. 

Then,  for  any  given  probability  measure  z/  on  the  Borel  cr-algebra  of  7Z  with 
bounded  support  S  =  «5(z/),  there  exists  a  set  Clo  C  such  that 

P'(no)  =  1  (4.4) 

and  for  any  (i,7i)  G  1}  €  fio, 

Iimsup(hminf)  \  ^  ^  g  (4  5^ 

n^oo  ^  n-.oo  ^  ^2n\ogn  ^  ^  ^  ' 

where 

/t  =  E{Il{X))  J  =  E  (//^(X))  (^J  {t-  J  3u{ds)fu{dt^  . 
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Remark  If  E{H{X))  =  0  and  0  <  <  cx),  then  for  almost  all 

choices  {cj^ni  ^  1}  of  triangular  arrays  of  real  numbers  with  sup^^  |ci,n|  < 
M  <  oo  for  some  constant  M  >  0,  the  L-statistics 

n 

y^Ci,n//(Xi,n),  n>l 

i=sl 

obey  the  Law  of  the  Logarithm,  i.e., 


0  <  lim  sup 

n  — *  oo 


IE 


y  271  log  n 


<  oo  a,s. 


It  follows  that 


..  IE’i=lC<,«^(^i:n)| 

lim  sup  - =  oo  a.s. 


n-^oo  \/2n  log  log  n 
Thus,  for  almost  all  choices  {ci^n;  (f » 'fi)  €  X}  of  triangular  arrays  of  real  numbers 
with  ^  A'f  <  OO,  the  LIL  for  L-statistics 


^  ^  71  >  1 


i=l 


fails. 


NOTE 

Some  of  the  results  of  this  paper  were  taken  from  the  technical  report  of  Li,  Rao 
and  Tomkins  (1993). 
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